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Abstract 

If a class of games is known to have a Nash equilibrium with probability values that are 
cither zero or f2(l) — and thus with support of bounded size — then obviously this equilibrium 
can be found exhaustively in polynomial time. Somewhat surprisingly, we show that there is a 
PTAS for the class of games whose equilibria arc guaranteed to have small — O(^) — values, 
and therefore large — f2(n) — supports. We also point out that there is a PTAS for games with 
sparse payoff matrices, a family for which the exact problem is known to be PPAD-complete [BJ. 
Both algorithms are of a special kind that we call oblivious: The algorithm just samples a fixed 
distribution on pairs of mixed strategies, and the game is only used to determine whether the 
sampled strategies comprise an e-Nash equilibrium; the answer is "yes" with inverse polynomial 
probability (in the second case, the algorithm is actually deterministic). These results bring 
about the question: Is there an oblivious PTAS for finding a Nash equilibrium in general games? 
We answer this question in the negative; our lower bound comes close to the quasi-polynomial 
upper bound of [15] , 

Another recent PTAS for anonymous games [131 1 141 [7] is also oblivious in a weaker sense 
appropriate for this class of games (it samples from a fixed distribution on unordered collections 
of mixed strategies), but its running time is exponential in -. We prove that any oblivious 
PTAS for anonymous games with two strategies and three player types must have 4r in the 
exponent of the running time for some a > |, rendering the algorithm in [7] (which works 
with any bounded number of player types) essentially optimal within oblivious algorithms. In 

contrast, we devise a poly(n) • (l/e) ^ los ^' e '' non-oblivious PTAS for anonymous games with 
two strategics and any bounded number of player types. The key idea of our algorithm is to 
search not over unordered sets of mixed strategies, but over a carefully crafted set of collections 
of the first O(logi) moments of the distribution of the number of players playing strategy 1 
at equilibrium. The algorithm works because of a probabilistic result of more general interest 
that we prove: the total variation distance between two sums of independent indicator random 
variables decreases exponentially with the number of moments of the two sums that are equal, 
independent of the number of indicators. 

A byproduct of our algorithm is establishing the existence of a sparse (and efficiently com- 
putable) e-cover of the set of all possible sums of n independent indicators, under the total 
variation distance. The size of the cover is poly(n) ■ (l/e)°( log t 1 / 6 )). 



*Extended version of the paper of the same title that appeared in STOC, 2009. 
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♦Supported by NSF grant CCF - 0635319, a gift from Yahoo! Research, and a MICRO grant. 
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1 Introduction 



Is there a polynomial time approximation scheme (PTAS) for computing approximate Nash equilib- 
ria? This has emerged, in the wake of the intractability results for Nash equilibria [£l[5], as the most 
central question in equilibrium computation. Over the past three years there has been relatively 
slow progress towards smaller e's [101 [TT| HI [2TJ — so slow that it is hard to believe that a PTAS is 
around the corner. On the other hand, |13|. [T4] provide a PTAS for the important special case of 
anonymous games with a bounded number of strategies (those for which the utilities of the players, 
although different, depend on the number of players playing each strategy, not on the identities of 
the players that do). This PTAS proceeds by discretizing the probabilities in the mixed strategies 
of the players to multiples of r, for appropriate integer k, and works even in the generalization in 
which the players are divided into a bounded number of types, and utilities depend on how many 
players of each type choose each strategy. 

In this paper we report significant progress on this important algorithmic problem; we present 
several new algorithms, but also the first nontrivial lower bounds. We start by pointing out two 
new interesting classes of bimatrix game £0 that have PTAS's: 

• It was shown in [6] that computing a Nash equilibrium for the special case of sparse games, 
that is, games whose payoff matrices have a bounded number of non-zero entries in each 
row and column [6], is PPAD-complete. We point out that there is a trivial PTAS — in 
particular, the pair of uniform mixed strategies works. This is interesting in that this is the 
first PPAD-complete case of a problem that is so approximable. 

• We also give a randomized PTAS for small probability games, that is, games that are guaran- 
teed to have Nash equilibria with small O(-) nonzero probability values, and thus with linear 
support (Theorem [3]) . 

It is quite surprising that games with small probability values (our second special case above) 
are easy, since games with large (bounded from below by a constant) probability values are also easy. 
What probability values are difficult then? Our next result, a lower bound, seems to suggest inverse 
logarithmic probability values are hard (compare with the quasi-PTAS of [18] . whose equilibria have 
roughly logarithmic support). 

To explain our negative result, we first note that both PTAS's outlined above (as well as those 
for anonymous games discussed later) are oblivious. This means that they have access to a fixed 
set of pairs of mixed strategies, in the generic case by sampling, and they look at the game only 
to determine whether a sampled pair of strategies constitutes an approximate Nash equilibrium. Is 
there an oblivious PTAS for the general Nash equilibrium? The answer here is a definite "no" - 
in fact, we proved our negative result after we had been working for some time on developing such 
an algorithm. . . We show that any oblivious algorithm must sample at least O (re(- 8-34e ) log2 n ) pairs 

in expectation (Theorem [4]) . For comparison, [I8]'s algorithm takes time n°v ogn//e ). 

Another important class of games for which a PTAS was recently discovered is that of anony- 
mous games with two strategies \13\ 17]. These are multi-player games, in which the utility of each 
player depends on the strategy (0 or 1) played, and the number of other players playing strategy 
1 (not their identities). In fact, the PTAS works even in the more sophisticated case in which the 
players are partitioned into types, and the utilities depend on the number of players of each type 
playing strategy 1. The PTAS in [13], and the relatively more efficient one in [7], both have run- 
ning times that are exponential in -. They are also oblivious in a sense appropriate for anonymous 

1 These results can be extended to any bounded number of players, but in what follows we only discuss the 
two-player, or bimatrix, case. 

2 



games, in that they work by sampling an unordered set of n mixed strategies, where n is the number 
of players, and they only look at the game in order to determine if there is an assignment of these 
strategies to the players that results in an approximate equilibrium. We prove that any oblivious 
approximation algorithm, for anonymous games with two strategies and three player types, must 
sample an exponential — in ^ — sized collection of unordered sets of mixed strategies — and so our 
PTAS's are near-optimal. 

Finally, we circumvent this negative result to develop a non-oblivious PTAS which finds an e- 
approximate Nash equilibrium in anonymous games with two strategies and any bounded number 
of player types in time poly(n) (I)°( log *\ This algorithm is based (in addition to many other 
insights and techniques for anonymous games) on a new result in applied probability which is, we 
believe, interesting in its own right: Suppose that you have two sums of n independent Bernoulli 
random variables, which have the same first moment, the same second moment, and so on up 
to moment d. Then the distributions of the two sums have variational distance that vanishes 
exponentially fast with d, regardless of n. To turn this theorem into an algorithm, we discretize 
the mixed strategies of the players using techniques from [7J and, in the range of parameters where 
the algorithm of [7J breaks down, we iterate over all possible values of the first log(l/e) moments 
of the players' aggregate behavior; we then try to identify, via an involved dynamic programming 
scheme, mixed strategies, implementing the given moments, which correspond to approximate Nash 
equilibria of the game. Our approximation guarantee for sums of independent indicators is rather 
strong, especially when the number of indicators is small, a regime where Berry-Esseen type bounds 
provide weaker guarantees and result in slower algorithms [EH [7J . It is quite intriguing that a quasi- 
polynomial time bound, such as the one we provide in this paper, shows up again in the analysis 
of algorithms for approximate Nash equilibria (cf. [18j). 

As a byproduct of our results we establish the existence of a sparse (and efficiently computable) 
e-cover of the set of all possible sums of n independent indicators, under the total variation distance. 
The size of our cover is poly(n) • (l/e)°( log ( 1 / <E )). We discuss this result in Section [6j 

1.1 Preliminaries 

A two-player, or bimatrix, game Q is played by two players, the row player and the column player. 
Each player has a set of n pure strategies, which without loss of generality we assume to be the 
set [n] := {1, ... ,n} for both players. The game is described then by two payoff matrices R, C 
corresponding to the row and column player respectively, so that, if the row player chooses strategy 
i and the column player strategy j, the row player gets payoff Rij and the column player CV,-. As 
it is customary in the literature of approximate Nash equilibria, we assume that the matrices are 
normalized, in that their entries are in [—1,1]. 

The players can play mixed strategies, that is, probability distributions over their pure strategies 
which are represented by probability vectors x € M", |x|i = 1. If the row player chooses mixed 
strategy x and the column player mixed strategy y, then the row player gets expected payoff x T Ry 
and the column player expected payoff x T Cy. A pair of mixed strategies (x, y) is a Nash equilibrium 
of the game Q = (R, C) iff x maximizes x' T Ry among all probability vectors x' and, simultaneously, 
y maximizes x T Cy' among all y' . It is an e-approximate Nash equilibrium iff x T Ry > x' T Ry — e, 
for all x', and, simultaneously, x T Cy > x T Cy' — e, for all y' . In this paper, we will use the stronger 
notion of e- approximately well- supported Nash equilibrium, or simply e-Nash equilibrium. This is 
any pair of strategies (x, y) such that, for all i with Xi > 0, eJRy > ef,Ry — e, for all i! , and similarly 
for y. That is, every strategy i in the support of x guarantees expected payoff eJRy which is within 
e from the optimal response to y, and similarly every strategy in the support of y is within e from 
the optimal response to x. 
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An anonymous game is in a sense the dimensional dual of a bimatrix game: There are n players, 
each of which has two strategies, and 1. For each player i there is a utility function U{ mapping 
{0,1} X [n — 1] to [—1,1]. Intuitively, Ui(s,k) is the utility of player i when s/he plays strategy 
s G {0, 1}, and k < n — 1 of the remaining players play strategy 1, while n — k — 1 play strategy 0. 
In other words, the utility of each player depends, in a player-specific way, on the strategy played 
by the player and the number of other players who play strategy 1 — but not their identities. 
The notions of Nash equilibrium and e-Nash equilibrium are extended in the natural way to this 
setting. Briefly, a mixed strategy for the z-th player is a function Xi : {0, 1} — > [0, 1] such that 
Xj(0) + Xj(l) = 1. A set of mixed strateg then an e-Nash equilibrium if, for every 

player i and every s € {0,1} with Xi(s) > 0: £ Xl ,...,x n u i( s i — ^xi,...,x n u i0- ~ s ik) — e, where for 
the purposes of the expectation k is drawn from {0, . . . , n — 1} by flipping n — 1 coins according to 
the distributions Xj, j ^ i, and counting the number of l's. 

A more sophisticated kind of anonymous games divides the players into t types, so that the 
utility of player i depends on the strategy played by him/her, and the number of players of each 
type who play strategy 1. 

2 PTAS for Two Special Cases 

2.1 Small Games 

We say that a class of bimatrix games is small if the sum of all entries of the R and C matrices is 
o(n 2 ). One such class of games are the k-sparse games [6], in which every row and column of both 
R and C have at most k non-zero entries. The following result by Chen, Deng and Teng shows 
that finding an exact Nash equilibrium remains hard for fe-sparse games: 

Theorem 1 ([6]). Finding a 0(n~®)-Nash equilibrium in 10-sparse normalized bimatrix games with 
n strategies per player is a PPAD-complete problem. 

In contrast, it is easy to see that there is a PTAS for this class: 

Theorem 2. For any k, there is a PTAS for the Nash equilibrium problem in k-sparse bimatrix 
games. 

Our original proof of this theorem consisted in showing that there always exists an e-Nash 
equilibrium in which both players of the game use in their mixed strategies probabilities that are 
integer multiples of e/2k. Hence, we can efficiently enumerate over all possible pairs of mixed 
strategies of this form, as long as k is fixed. Shang-Hua Teng pointed out to us a much simpler 
algorithm: The pair of uniform mixed strategies is always an e-Nash equilibrium in a sparse game! 
The difference with our algorithm is this: the uniform equilibrium gives to both players payoff of at 
most k/n; our algorithm can be used instead to approximate the payoffs of the players in the Nash 
equilibrium with the optimal social welfare (or more generally the Nash equilibrium that optimizes 
some other smooth function of the players' payoffs). 

2.2 Small Probability Games 

If all games in a class are guaranteed to have a Nash equilibrium (x,y), where the nonzero prob- 
ability values in both x and y are larger than some constant 5 > 0, then it is trivial to find this 
equilibrium in time n°'*' by exhaustive search over all possible supports and linear programming. 
But, what if a class of games is known to have small, say O(^), probability values? Clearly, exhaus- 
tive search over supports is not efficient anymore, since those have now linear size. Surprisingly, we 
show that any such class of games has a (randomized) PTAS, by exploiting the technique of [18] . 
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Definition 1 (Small Probability Games). A bimatrix game Q = (R,C) is o/<5-smail probabilities, 
for some constant 5 G (0, 1], if it has a Nash equilibrium (x,y) such that all the entries of x and y 
are at most j^. 

Remark 1. Observe that a game of 5 -small probabilities has an equilibrium (x,y), in which both 
x and y have support of size at least 5n. Moreover, there exists a subset of size at least 4p from 
the support of x, all the strategies of which have probability at least and similarly for y; that is 
the probability mass of the distributions x and y spreads non-trivially over a subset of size O(n) of 
the strategies. Hence, small probability games comprise a subclass of linear support games, games 
with an equilibrium (x, y) in which both x and y assign to a constant fraction an of the strategies 
probability at least l/(3n, for some constants a and f3. However, this broader class of games is 
essentially as hard as the general: take any Nash equilibrium (x, y) of a normalized game and 
define the pair {x! , y'), where x' := (1 — |) • x + | ■ -,...,-) and similarly for y' . It is not hard 
to see that the new pair is an e-Nash equilibrium; still, regardless of what (x, y) is, both x' and y' 
assign to an strategies probability at least 1/fin, for an appropriate selection of a and f3. 

Theorem 3. For any 5 G (0,1], there is a randomized PTAS for normalized bimatrix games of 
5-small probabilities. 

Proof. We show first the following (stronger in terms of the type of approximation) variant of the 
theorem of Lipton, Markakis and Mehta j!8j . The proof is provided in Appendix lA.il 

Lemma 1. Let Q = (R,C) be a normalized bimatrix game and (x,y) a Nash equilibrium of Q . Let 
X be the distribution formed by taking t = [~161ogn/e 2 ] independent random samples from x and 
defining the uniform distribution on the samples, and similarly define y by taking samples from y. 
Then with probability at least 1 — - the following are satisfied 

1. the pair (X,y) is an e-Nash equilibrium of Q; 

2. \eJRy - eJRy\ < e/2, for all i G [n]; 

3. \X T Cej - x T CeA < e/2, for all j G [n]; 

Suppose now that we are given a normalized bimatrix game Q = (R, C) of (5-small probabilities, 
and let (x,y) be an equilibrium of Q in which X{ < 4-, for all i G [n], and similarly for y. Lemma CD 
asserts that, if a multisetH A of size t = [161ogn/e 2 ] is formed by taking t independent samples 
from x and, similarly, a multiset B is formed by taking samples from y, then (X,y), where X is 
the uniform distribution over A and 3^ the uniform distribution over B, is an e-Nash equilibrium 
with probability at least 1 — 4/n. Of course, we do not know (x,y) so we cannot do the sampling 
procedure described above. Instead we are going to take a uniformly random multiset A' and a 
uniformly random multiset B' and form the uniform distributions X',y' over A' and B'; we will 
argue that there is an inverse polynomial chance that (X',y') is actually an e-Nash equilibrium. 

For this we define the set A of good multisets for the row player as 



A:=<A 



A is a multiset, AC [n], \A\ = t, the") 
uniform distribution X over A satisfies ? 
Assertion [3] of Lemma [T] > 



2 For our discussion, a multiset of size t is an ordered collection {ii,i2, ■ ■ ■ ,it) of t elements from some universe 
(repetitions are allowed). 
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and, similarly, the set B of good multisets of the column player as 



B is a multiset, B C [n], \B\ = t, the"! 
uniform distribution y over 1? satisfies } ■ 
Assertion [2] of Lemma [T] J 

The reason for defining A and £> in this way is that, given two multisets A € A, B € B, the uniform 
distributions X over ^4 and y over i? comprise an e-Nash equilibrium (see the proof of Lemma Q] 
for a justification). 

What remains to show is that, with inverse polynomial probability, a random multiset A' belongs 
to A and a random multiset B' belongs to B. To show this we lower bound the cardinalities of 
the sets A and B via the following claim, proven in Appendix IA.ll We argue that the subset of 
A containing elements that could arise by sampling x is large: indeed, with probability at least 
1 — — , a multiset sampled from x belongs to A and, moreover, each individual multiset has small 
probability of being sampled, since x spreads the probability mass approximately evenly on its 
support. 

Claim 1. The sets A and B satisfy 

\A\ >(l-^\ (Snf and \B\ > (l - (Sri)* . 

Given Claim [H we can show Claim [2j the proof is given in Appendix lA.il Equation ([I]) implies 
that the algorithm that samples two uniformly random multisets A', B' and forms the uniform 
probability distributions X' and y' over A' and B' respectively, succeeds in finding an e-Nash 
equilibrium with probability inverse polynomial in n. This completes the proof of Theorem [3l 

Claim 2. If X',y' are the uniform distributions over random multisets A' and B' then 

Pr \[X* ^y 1 ) is an e-Nash equilibrium^ 

= fi(«5 2 -n- 321 °s( 1 / 5 )/ e2 ) . (1) 

□ 




3 A Lower Bound for Bimatrix Games 

The two PTAS's presented in the previous section are oblivious. An oblivious algorithm looks at 
the game only to check if the various pairs of mixed strategies it has come up with (by enumeration 
or, more generally, by random sampling) are e-approximate, and is guaranteed to come up with 
one that is with probability at least inverse polynomial in the game description. More formally, an 
oblivious algorithm for the Nash equilibrium problem is a distribution over pairs of mixed strategies, 
indexed by the game size n and the desired approximation e. It is a PTAS if for any game the 
probability that a pair drawn from the distribution is an e-Nash equilibrium is inversely polynomial 
in n. Notice that, since we are about to prove lower bounds, we are opting for the generality of 
randomized oblivious algorithms — a deterministic algorithm that enumerates over a fixed set of 
pairs of mixed strategies can be seen as a (randomized) oblivious algorithm by considering the 
uniform distribution over the set it enumerates over. 

The rather surprising simplicity and success of these algorithms (as well as their cousins for 
anonymous games, see the next section) raises the question: Is there an oblivious PTAS for the 
general Nash equilibrium problem? We show that the answer is negative. 
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Theorem 4. There is no oblivious PTAS for the Nash equilibrium in bimatrix games. 

Proof. We construct a super-polynomially large family of n x n games with the property that every 
two games in the family do not share an e-Nash equilibrium. This quickly leads to the proof of the 
theorem. 

Our construction is based on a construction by Althofer [I], except that we need to pay more 
attention to ensure that the e-Nash equilibria of the games we construct are "close" to the exact 
Nash equilibria. For £ even and n = (^ 2 )> we define a family of n x n two-player games Qs = 
(Rs,Cs), indexed by all subsets S C [n] with |,S| = £. Letting {S±,S2, ■ ■ ■ , S n } be the set of all 
subsets of S with cardinality £/2, we imagine that column j of the game Qs corresponds to subset 
Sj. Then, for every j, we fill column j of the payoff matrices Rs and Cs as follows: 

• for all i £ S, Rs,ij = — 1 and Cs,ij = 1; 

• for all i G Sj, Rs,ij = 1 and @S,ij = 0; and 

• for all i G S\ Sj, Rs,%j = and Cs,ij = 1. 

In other words, our construction has two components: In the first component (defined by the rows 
labeled with the elements of S), the game is 1-sum, whereas in the second (corresponding to the 
complement of S) the game is 0-sum with the row player always getting payoff of —1 and the 
column player always getting payoff of 1. The payoffs of the first component are more balanced in 
the following way: as we said, every column corresponds to a subset S\ . . . , S n of S of cardinality £/2; 
if the column player chooses column j, then the row player gets 1 for choosing a row corresponding 
to an element of Sj and for a row corresponding to an element in S\Sj. See Figure Q] of Appendix 
IA.2l for an illustration of Rs for the case n = 6, £ = 4, S = {1,2,3,4}. 

Lemma [2] provides the following characterization of the approximate equilibria of the game Qs'- 
in any e-Nash equilibrium (x,y), the strategy x of the row player must have £\ distance at most 
8e from us — the uniform distribution over the set S. That is, in all approximate equilibria of the 
game the strategy of the row player must be close to the uniform distribution over S. Formally, 

Lemma 2. Let e < 1. If (x,y) is an e-Nash equilibrium of the game Qs, where x is the mixed 
strategy of the row player and y that of the column player, then the following properties are satisfied 
by x: 

1. Xi = 0, for all i ^ S; 

2. £\{x,us) < 8e, where us is the uniform distribution over S, and £\{x,us) represents the £\ 
distance between distributions x, us- 

The proof of the first assertion is straightforward: the row player will not assign any probability 
mass to the rows which give her —1, since any row in S will guarantee her at least 0. Since all the 
activity happens then in the first component of the game, which is 1-sum, an averaging argument 
implies that both players' payoff is about 1/2 at equilibrium. Observe further that, for a given 
mixed strategy of the row player, the strategy of the column player that guarantees her the highest 
payoff is the subset containing the £/2 elements of S to which the row player assigns the smallest 
probability mass. Hence, if the probability distribution of the row player were far from uniform, 
then, contrary to what we argued, the corresponding payoff for the column player would be larger 
than 1/2 — this is established via a delicate geometric argument for £\ distances of probability 
measures. See Lemma [3] in Appendix IA.2I 

Suppose now that there is an oblivious PTAS for the Nash equilibrium, that is, a distribution 
D over pairs of mixed strategies such that, for any game Qs, the probability that an e-approximate 
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Nash equilibrium is sampled is inverse polynomial in n. Let us consider the probability distribution 
Dr induced by D on the mixed strategies of the row player and denote by B$ the i\ ball of radius 
8e around us- Lemma [2] implies that Dr should be assigning probability mass at least inverse 
polynomial in n to each ball B$, SO [n], \S\ = £. This is impossible, since by the following claim 
there is a super-polynomial number of disjoint such balls. The proof of the claim is via a counting 
argument. See Appendix IA. 21 

Claim 3. There is a family o/fi (n,(' 8_34e ) log2 n ) disjoint such balls. 

□ 

The proof of Theorem H] implies in particular that any oblivious PTAS for general two-player 
games requires expected running time of at least f2 (n(' 8_34e ) log2 n ) . Compare this bound to the 

n O(logn/e 2 ) upper 

bound obtained by Lipton, Markakis and Mehta j!8j . 

4 A Lower Bound for Anonymous Games 

Recall the definition of anonymous games from Section ri.il In |13| we give a PTAS for anonymous 
games with two strategies, running in time n ^ 1 / 6 ) \ and in [7] a more efficient one, with running 
time n°« • (l/e)°(( 1 A) 2 ). (T n [J2E] we also give a much more sophisticated PTAS for anonymous 
games with more than two strategies). All these PTAS's have | in the exponent of the running 
time, and they work even if there is a fixed number t of types (in which case t multiplies the 
exponent). Furthermore, it turns out that all of these algorithms are oblivious, in a specialized 
sense appropriate for anonymous games defined next. 

An oblivious e- approximation algorithm for anonymous games with n players is defined in terms 
of a distribution, indexed by n, on unordered n-tuples of mixed strategies^ The algorithm sam- 
ples from this distribution, and for each {pi, . . . ,p n } sampled, it determines whether there is an 
assignment of these probabilities to the n players such that the resulting strategy profile (with each 
player playing strategy 1 with the assigned probability) is an e-approximate Nash equilibrium; this 
latter test can be carried out by max-flow techniques, see, e.g., [13]. The expected running time of 
this approximation algorithm is then the inverse of its probability of success. 

We show the following result, implying that any oblivious e- approximation algorithm for anony- 
mous games whose expected running time is polynomial in the number of players must have ex- 
pected running time exponential in (^) 1//3 . Hence, our PTAS from [7j is essentially optimal among 
oblivious PTAS's. 

Theorem 5. For any constant c > 0, e < 1, no oblivious e- approximation algorithm for anonymous 
games with 2 strategies and 3 player types has probability of success larger than n~ c ■ 2^( 1 / el/3 ). 

We only sketch the proof next and postpone the details for Appendix [Bj We first show the 
following (see TheoremHUlin Appendix IB.lh : given any ordered n-tuple (p±, . . . ,p n ) of probabilities, 
we can construct a normalized anonymous game with n players of type A, and two more players 
of their own type, such that in any e-Nash equilibrium of the game the z-th player of type A plays 
strategy 1 with probability very close (depending on e and n) to p^. To obtain this game, we need to 
understand how to exploit the difference in the payoff functions of the players of type A to enforce 
different behaviors at equilibrium, despite the fact that in all other aspects of the game the players 
of group A are indistinguishable. 

3 For ordered sets of mixed strategies, the lower bound we are about to show becomes trivial and uninteresting. 
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The construction is based on the following idea: For all i, let us denote by := Ylj^iPj the 
target expected number of type- A players different than i who play strategy 1; and let us give this 
payoff to player i if she plays strategy 0, regardless of what the other players are doing. If i chooses 
1, we give her payoff t where t is the number of players different than i who play 1. By setting the 
payoffs in this way we ensure that (p±, . . . ,p n ) is in fact an equilibrium, since for every player the 
payoff she gets from strategy matches the expected payoff she gets from strategy 1. However, 
enforcing that (pi, . . . ,p n ) is also the unique equilibrium is a more challenging task; and to do this 
we need to include two other players of their own type: we use these players to ensure that the 
sum of the mixed stategies of the players of type A matches ^2pi at equilibrium, so that a player 
i deviating from her prescribed strategy pi is pushed back towards pi. We show how this can be 
done in Appendix lB.il We also provide guarantees for the e-Nash equilibria of the resulting game. 

The construction outlined above enables us to define a family of 2 f ^ 1 / el 3 ) anonymous games 
with the property that no two games in the family share an e-Nash equilibrium, even as an unordered 
set of mixed strategies (Claims [7J and |SJ). Then, by an averaging argument, we can deduce that 
for any oblivious algorithm there is a game in the ensemble for which the probability of success 
is at most 2 -fi ( 1 / el 3 ). It is important for our construction to work that the anonymous game 
defined for a given collection of probability values (pi,P2, ■ ■ ■ ,Pn) does not deviate too much from 
the prescribed set of mixed strategies pi,pz, ■ ■ ■ ,p n even in an e-Nash equilibrium. The bound of 
2^(1/ e 1 / 3 ) emer g es f rom a quantification of this deviation as a function of e. The proof of Theorem [5] 
is given in Appendix IB. 21 

Remark 2. We can show an equivalent of Theorem^ for oblivious e- approximation algorithms for 
anonymous games with 2-player types and 3 strategies per player. The details are omitted. 

5 A Quasi-polynomial PTAS 

We circumvent the lower bound of the previous section by providing a PTAS for anonymous games 
with running time polynomial in the number of players n times a factor of (i)°( lo s 7). The PTAS 
is, of course, non-oblivious, and in fact in the following interesting way: Instead of enumerating a 
fixed set of unordered collections of probability values, we enumerate a fixed set of \og{l/e) -tuples, 
representing the first log(l/e) moments of these probability values. We can think of the these 
moments as more succinct aggregates of mixed strategy profiles than the unordered collections of 
strategies considered in [TJ [13], since several of these collections may share the same moments. To 
put the idea into context, let us recall the following theorem. 

Theorem 6 ([7J [8]). For every e > 0, there exists some integer k = 0(l/e) such that for any 
n-player 2-strategy anonymous game with payoffs in [—1, 1] there is an e-Nash equilibrium such 
that 

1. either at most fe 3 players randomize, and their mixed strategies are integer multiples of l/k 2 ; 

2. or all players who randomize use the same mixed strategy, and this strategy is an integer 
multiple of 

This structural result can be turned into an oblivious PTAS using max-flow arguments (see 
Appendix ID. II for details). At its heart the proof of the theorem relies on the following intuitive 
fact about sums of indicator random variables: If two sums of independent indicators have close 
means and variances, then their total variation distance should be small. The way this fact becomes 
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relevant to anonymous games is that, if there are 2 strategies per player, then the mixed strategy 
of a player can be described by an indicator random variable; and as it turns out, if we replace 
one set of indicators by another, the change in payoff that every player will experience is bounded 
by the total variation distance between the sum of the indicators before and after the change. 
Nevertheless, the bound obtained by approximating the first two moments of the sum of the Nash 
equilibrium strategies is weak, and the space of unordered sets of probability values that we need 
to search over becomes exponential in 1/e. 

To obtain an exponential pruning of the search space, we turn to higher moments of the Nash 
equilibrium. We show the following theorem, which provides a rather strong quantification of how 
the total variation distance between two sums of indicators depends on the number of their first 
moments that are equal. 

Theorem 7. Let V := (pi)f =1 G (0,l/2] n and Q := (ft)i=l G (0,l/2] n be two collections of proba- 
bility values in (0,1/2]. Let also X := (Xi)f =1 and y := (Yi)f =1 be two collections of independent 
indicators with £[Xj\ = pi and £[Yj] = qi, for all i € [n]. If for some d 6 [n] the following condition 
is satisfied: 

n n 

(C d ): J>f = $>f, forall£=l,...,d, 

i=l i=l 



then 



£* 



<20(d + l) 1 / 4 2"( d+1 )/ 2 . 



(2) 



Condition (Cd) considers the power sums of the expectations of the indicator random variables. 
Using the theory of symmetric polynomials we can show that (Cd) is equivalent to the follow- 
ing condition on the moments of the sums of the indicators (for the proof see Proposition Q] in 
Appendix |C|) : 

\ f 



(V d ) 



£ 



' n 



Xi 



£ 



' n 

£ 



Yi 



for all £e [d]. 



Theorem [7] provides then the following strong approximation guarantee for sums of indicator random 
variables, that we think should be important in other settings. Our result is related to the classical 
moment method in probability theory [15] , but to our knowledge it is novel and significantly stronger 
than known results: 

If two sums of independent indicators with expectations bounded by 1/2 have equal first d 
moments, then their total variation distance is 2~^ d \ 

It is important to note that our bound in (j2J) does not rely on summing up a large number of 
indicators n. This is quite critical since the previous techniques break down for small n's — for large 
n's Berry-Esseen type bounds are sufficient to obtain strong guarantees (this is the heart of the 
probabilistic results used in [131 17]). 

The proof of Theorem [7] (and its complement for probability values in [1/2,1)) is given in 
AppendixO It proceeds by expressing the distribution of the sum of n indicators, with expectations 
pi,...,p n , as a weighted sum of the binomial distribution B(n,p) (with p = p = ^2pi/n) and its 
n derivatives with respect to p, at the value p = p (these derivatives correspond to finite signed 
measures). It turns out that the coefficients of the first d terms of this expansion are symmetric 
polynomials with respect to the probability values pi,...,p n , of degree at most d; hence, from 
the theory of symmetric polynomials, each of these coefficients can be written as a function of the 
power-sum symmetric polynomials YliPii £ = 1, ■ ■ ■ ,d (see, e.g., [22]). So, if two sums of indicators 
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satisfy Condition (Cd), the first terms cancel, and the total variation distance of the two sums 
depends only on the other terms of the expansion (those corresponding to higher derivatives of 
the binomial distribution). The proof is concluded by showing that the joint contribution of these 
terms is inverse polynomial in 2^^. (The details are given in Appendix ICj) . 

Our algorithm, shown below, exploits the strong approximation guarantee of Theorem [7J to 
improve upon the algorithm of [7J in the case where only 0(l/e 3 ) players mix at the e-Nash equi- 
librium (this corresponds to case 1 in Theorem [6|). The complementary case (case 2 in Theorem [6]) 
can be treated easily in time polynomial in n and 1/e by exhaustive search and max-flow arguments 
(see Appendix ID. ip . 

Algorithm Moment Search 

Input: An anonymous game Q, the desired approximation e. 

Output: An e-Nash equilibrium of Q in which all probabilities are integer multiples of where 
k = [|] and c is universal (independent of n) constant, determined by Theorem [H For technical 
reasons that will be clear shortly, we choose a value for k that is by a factor of 2 larger than 
the value required by Theorem [6j this is the value k that guarantees an e/2-Nash equilibrium in 
multiples of 1/k 2 . Finally, we assume that we have already performed the search corresponding to 
Case 2 of Theorem [6] for this value of k and we have not found an e/2-Nash equilibrium. So there 
must exist an e/2-Nash equilibrium in which at most A; 3 players randomize in integer multiples of 
1/k 2 . 

1. Guess integers to,ti,t s ,tb < n, t s + tb < k 3 , where to players will play pure strategy 0, 
t\ will play pure strategy 1, t s will mix with probability < ^, and tb = n — to — t\ — t s 
will mix with probability > ^. (Note that we have to handle low and high probabilities 
separately, because Theorem [7] only applies to indicators with expectations in (0,1/2]; we 
handle indicators with expectations in (1/2,1) by taking their complement and employing 
Theorem [7J — see Corollary [JJ) 

2. For d = [3 log 2 (320/e)] , guess fix, fi2, ■ • •> Hd-, Mi; /4i • • ■> A 4 ^ where, for all I £ [d]: 

*e|i(i) : t.<i<t.(£) }, 

and 

For all £, fi£ represents the ^-power sum of the mixed strategies of the players who mix 
and choose strategies from the set {1/A; 2 , . . . , 1/2}. Similarly, fi' e represents the ^-power sum 
of the mixed strategies of the players who mix and choose strategies from the set {1/2 + 
1/k 2 , . . . , (k 2 — l)/k 2 }. Remark: Whether there actually exist probability values 7Ti, . . . ,irt s G 
{1/k 2 ,... ,1/2} and 6>i,...,0 t6 G {1/2 + 1/k 2 , . . . , (k 2 - l)/k 2 } such that /x £ = J2l=i A and 
lj! t = Yli=i ^f, for all £ = 1, 2, ... , d, will be determined later. 

3. For each player i = 1, . . . ,n, find a subset 

^ f 1 k 2 -l } 



of permitted strategies for that player in an |-Nash equilibrium, conditioned on the guesses 
in the previous steps. By this, we mean determining the answer to the following: "Given our 
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guesses for the aggregates to, t±, t s , tb, fJ>e, n'g, for all £ 6 [d], what multiples of 1/k 2 could 
player i be playing in an e /2-Nash equilibrium?" Our test exploits the anonymity of the game 
and uses Theorem [7J to achieve the following: 

• if a multiple of 1/k 2 can be assigned to player i and complemented by choices of multiples 
for the other players, so that the aggregate conditions are satisfied and player i is at 3e/4- 
best response (that is, she experiences at most 3e/4 regret), then this multiple of 1/k 2 
is included in the set S^; 

• if, given a multiple of 1/k 2 to player i, there exists no assignment of multiples to the 
other players so that the aggregate conditions are satisfied and player i is at 3e/4-best 
response, the multiple is rejected from set Si. 

Observe that the value of 3e/4 for the regret used in the classifier is intentionally chosen 
midway between e/2 and e. The reason for this value is that, if we only match the first d 
moments of a mixed strategy profile, our estimation of the real regret in that strategy profile 
is distorted by an additive error of e/4 (coming from (|2|) and the choice of d). Hence, with a 
threshold at 3e/4 we make sure that: a. we are not going to "miss" the e/2-Nash equilibrium 
(that we know exists in multiples of 1/k 2 by virtue of our choice of a larger k), and b. any 
strategy profile that is consistent with the aggregate conditions and the sets Si found in this 
step is going to have regret at most 3e/4 + e/4 = e. The fairly involved details of our test 
are given in Appendix ID. 21 and the way its analysis ties in with the search for an e-Nash 
equilibrium is given in the proofs of Claims [9] and [10] of Appendix ID.3I 

4. Find an assignment of mixed strategies v± 6 S±, . . ., v n G S n to players, such that: 

• to players are assigned value and t\ players are assigned value 1; 

• t s players are assigned a value in (0, 1/2] and X^-^e(o 1/2] v i = M€> f° r au ^ £ [d]'i 

• tb players are assigned a value in (1/2, 1) and ^r^e(i/2 1) vf = /i^, for all £ £ [d]. 

Solving this assignment problem is non-trivial, but it can be done by dynamic programming 
in time 



0{n 



3\ 



lN o(io g 2 (iA)) 



because the sets Si are subsets of {0, 1/k 2 , . . . , 1}. The algorithm is given in the proof of 
Claim [TT1 in Appendix ID.3I 

5. If an assignment is found, then the vector (vi,. . . ,v n ) constitutes an e-Nash equilibrium. 

Theorem 8. Moment Search is a PTAS for n-player 2-strategy anonymous games with running 
time U ■ poly(n) • (l/e)°( log ( x ' e >\ where U is the number of bits required to represent a payoff value 
of the game. The algorithm generalizes to a constant number of player types with the number of 
types multiplying the exponent of the running time. 

Sketch: Correctness follows from this observation: The results in [7] and the choice of k guarantee 
that an ^-approximate Nash equilibrium in discretized probability values exists; therefore, Step 3 
will find non-empty 5j's for all players (for some guesses in Steps 1 and 2, since in particular the 
e/2-Nash equilibrium will survive the tests of Step 3 — by Theorem [7J and the choice of d, at most 
e/4 accuracy is lost if the correct values for the moments are guessed); and thus Step 4 will find an 
e-approximate Nash equilibrium (another e/4 might be lost in this step). The full proof and the 
running time analysis are provided in Appendix ID.3I 
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6 A Sparse e-cover for Sums of Indicators 



A byproduct of our proof is showing the existence of a sparse (and efficiently computable) e-cover 
of the set of sums of independent indicators, under the total variation distance. To state our cover 
theorem, let S := {{Xi}i \ X\, . . . ,X n are independent indicators}. We show the following. 

Theorem 9 (Cover for sums of indicators). For all e > 0, there exists a set S e C S such that (i) 

\S e \ < n 3 -0(l/e) +n- (I)°( log 1 e ^ (U) For every {Xi}i E S there exists some {Yi}i E S e such that 

d r ry(^2 i Xi, Yi) < e; and (Hi) the setS e can be constructed in time O (ji 3 ■ 0(l/e) + n ■ (I)°( log ^ 

Moreover, if {Yi}i E S e , then the collection {Yi}i has one of the following forms, where k = k(e) = 
0(1/ e) is a positive integer: 

• (Sparse Form) There is a value £ < k 3 = 0(1 /e 3 ) such that for all i < £ we have £\Yj\ E 

i}, and for all i > £ we have f [Y-] E {0, 1}. 

• (k-heavy Binomial Form) There is a value £ E {0, 1, . . . , n} and a value q E -3-, ■ ■ ■ , kr \^ } 
such that for all i < £ we have £\Yj\ = q; for all i > I we have £ [Yi] E {0, 1}; and £, q satisfy 
the bounds £q > k 2 - I and £q(l — q) > k 2 — k — 1 — |. 

Proof of Theorem [9l Daskalakis [8] establishes the same theorem, except that the size of the 
cover he produces, as well as the time needed to produce it, are n ■ 0(l/e)+n- (I)° (1/e2) . Indeed, 
this bound is obtained by enumerating over all possible collections {Y{\i in sparse form and all 
possible collections in /c-heavy Binomial Form, for k = 0(1/ e) specified by the theorem. Indeed, 
the total number of collections in /c-heavy Binomial form is at most (n + l) 2 nk = n 3 ■ 0(1/ e), since 
there are at most n + 1 choices for the value of £, at most kn choices for the value of q, and at 
most n + 1 choices for the number of variables indexed by i > £ that have expectation equal to 
1 (the precise subset of these that have expectation 1 is not important, since this does not affect 
the distribution of Yi). On the other hand, the number of collections {Y{\i in sparse form is at 

most (k 3 + l)-k 3k -(n + l) =n-{\) { /e \ since there are k 3 + 1 choices for £, k 3k2 choices for the 
expectations of variables Y\, . . . , Yj* up to permutations of the indices of these variables (namely we 
need to choose how many of these £ variables have expectation 1/k 2 , how many have expectation 
2/k 2 , etc.), and at most n + l choices for the number of variables indexed by i > £ that have 
expectation equal to 1. 

To improve on the size of the cover we show that we can remove from the aforementioned cover 
a large fraction of collections in sparse form. In particular, we shall only keep n • (I)°^ log 1//e - > 
collections in sparse form, making use of Theorem [7l Indeed, consider a collection 3^ = \Y{\i in 
sparse form and let Cy = {i | £[Yi\ E (0, 1/2]} C [n], TZy = {i | £[Yi\ E (1/2, 1)} C [n]. Theorem[7] 
implies that, if we compare {Yi}i with another collection {Zi}i satisfying the following: 

= ]T£W, for alii = l,...,d; (3) 

i<=£ i£C 

^£[Y i ] t = ^£[Zi}\ foralH = l,...,d; (4) 

£[Yi\ = £[Zi], for all i E [n] \ (C U 11), (5) 

then d< TV (Y ji Yi,Y ji Z.i) < 2 • 20(d + l) 1 /^"^ 1 )/ 2 . In particular, for some d(e) = 0(logl/e), this 
bound becomes at most e. 
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For a collection y = {Yi}i, we define the moment profile my of the collection to be a (2d(e) + 1)- 
dimensional vector 



i e £ M, E ^^i 2 ' ■ • • > E E ■ • • > E ^^] d(£) ; K* i *M = m 

By the previous discussion, for two collections 3^ = {Yi}i and 2 = {Zi}i, if 771,3; = m -Z then 

Now given the e-cover produced in [8] we perform the following sparsification operation: for 
every possible moment vector that can arise from a collection \Yi\i in sparse form, we only keep 
in our cover one collection with such moment vector. The cover resulting from the sparsification 
operation is a 2e-cover, since the sparsification loses us an additive e in total variation distance, as 
argued above. We now compute the size of the new cover. The total number of moment vectors 
arising from sparse-form collections of indicators is at most k°^ d ^ ) • (n + 1). Indeed, consider a 
collection y in sparse form. There are at most k 3 + 1 choices for \Cy\, at most k 3 + 1 choices for 
\TZy\, and at most (n + 1) choices for \{i \ £[Yi] = 1}|. We claim next that the total number of 
possible vectors 

E^],E^] 2 '---'E^] d(e) 

is at most k°^ 2 \ Indeed, for all * = 1, . . . , d(e), Y,ieC y s \Yi\* ^ lAyl and [t must be a multiple of 
l/k 2t . So the total number of possible values for YlieCy ^WiY is at most (k 2t \Cy\ + 1) < (k 2t k 3 + l). 
It's easy to see then that the number of possible moment vectors 

E^],E^] 2 '---'E^] d(e) 

yi&Cy i&Cy i&Cy 

d(e) 

H(k 2t k 3 +i)<k°^ 2 \ 

t=l 

The same upper bound applies to the total number of possible moment vectors 

E^],E^] 2 '---'E^] d(e) 

^iGTly i&ly i&TZy 

It follows then that the total number of sparse- form collections of indicators that we have kept in our 
cover after the sparsification operation is at most /c°( rf ( e ) 2 ) • (n + 1) = n - (I)°( log l ^ e \ The number 
of collections in heavy Binomial form that we have in our cover is the same as before and hence it 
is at most n 3 • 0(l/e). So the size of the sparsified cover is at most n 3 • 0(l/e) + n ■ (I)°( log 1 ^ e \ 
To finish the proof it remains to argue that we don't actually need to produce the cover of [8] 
and subsequently sparsify it to obtain our cover, but we can produce it directly in time n 3 -0(l/e) + 
n . (I)°( lo s V<0_ We claim that 

given a moment vector m we can compute a collection y = {Yi}i 
such that my = m, if such a collection exists, in time (I^ 0( - log V e \ This follows from Claim [TT1 in 



is at most 
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Appendix El U Hence, our algorithm producing the cover enumerates over all possible moment 
vectors and for each moment vector invokes Claim [TT] to find a consistent sparse collection of 
indicators, if such collection exists, adding that collection into the cover. Then it enumerates over 
collections of indicators in heavy Binomial form and adds them to the cover. The overall running 
time is as promised. ■ 

7 Discussion and Open Problems 

The mystery of PTAS for Nash equilibria deepens. There are simple algorithms for interesting 
special cases well within reach, and in fact we have seen that the existence of a PTAS is not 
incompatible with PPAD-completeness. But oblivious algorithms cannot take us all the way to 
the coveted PTAS for the general case. In the important special case of anonymous games, the 
approach of [13 1 114 1 17] — by design involving oblivious algorithms — hits a brick wall of but 
then a more elaborate probabilistic result about moments and Bernoulli sums breaks that barrier. 
Pseudopolynomial bounds, familiar from [18], show up in approximation algorithms for anonymous 
games as well. 

Many open problems remain, of course: 

• Is there a PTAS for Nash equilibria in general games? A PTAS for bimatrix games that 
exploits the linear programming-like nature of the problem would not be unthinkable. 

• Find a truly practical, and hopefully evocative of strategically interacting crowds, PTAS for 
anonymous games with two strategies. 

• Prove that finding an exact Nash equilibrium in an anonymous game with a finite number of 
strategies is PPAD-complete. 

• Find a PTAS for 2-strategy graphical games — the other important class of multi-player 
games. 

• Alternatively, it is not unthinkable that the graphical games special case above is PPAD- 
complete to approximate sufficiently close. 
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A Bimatrix Games 



A.l PTAS for Small Probability Games 

Proof of Lemma [1} Let X and Y be independent random variables such that 

X = &i , with probability , for all i G [n], 

Y = ej, with probability yj , for all j G [n] . 

Let then X±, X2, ■ ■ ■ , Xt be i copies of variable X and Yi,l2i . .., It be t copies of variable V, 
where the variables X±,. . ., X t , Y\, . . ., Y t are mutually independent. Setting X = j J2k=i -^k and 
y = fX/fc=i^fc> as in the statement of the theorem, we will argue that, with high probability, 
(X,y) is an e-Nash equilibrium of Q. 

Let Ui = eJRy and V« = X T Cei be the payoff of the row and column player respectively for 
playing strategy i G [n]. Fixing i G [n], we have that 

1 * 

Ui = j^ejRY k , 

k=l 



t - t 



EPU] = ^E[ejRY k ] = ^E[eJ RY] 

k=l k=l 

= E[ejRY] = VjefRej = ejRy. 
je[n] 

An application of McDiarmid's inequality on the function /(Ai, . . . , At) = j ~Y^k=i ^-fc> where A/% := 
ejRYk, k G [t], are independent random variables, gives 

Pr^-EMI > e/2] < 2 e -"# < \. 

Applying a union bound, it follows that with probability at least 1 — — the following properties are 
satisfied by the pair of strategies (X,y): 

\ejRy - efRy\ < e/2, for all i G [n]; (6) 
\X T C ej - x T Cej\ < e/2, for all j G [n]. (7) 

The above imply that (X,y) is an e-Nash equilibrium. Indeed, for all G [n], we have that 

eJRy > eJ.Ry + e 

=> e^y > e^iZy - e/2 > eJ,Ry + e/2 > eJiZy 
Xj/ = => Afj/ = 0, 

where the last implication follows from the fact that X is formed by taking a distribution over 
samples from x. Similarly, it can be argued that, for all j,f G [n], 

X T C ej > X T Ce f + e => y,y = 0. 



17 



Proof of Claim [1} We are only going to lower bound the cardinality of the set A. A similar 
argument applies for B. Recall that (x,y) is a Nash equilibrium in which x\ < for all i G [n], 
and similarly for y. 

Let us now define the set A' as follows 

A' := {A \ A e A and Xi > 0,Vi £ A} C .4, 

that is, .A' is the subset of A. containing those multisets that could arise by taking t samples from x. 
We are going to use the structure of the probability distribution x and Lemma [T] to argue that A' is 
large. For this, let us consider the random experiment of taking t independent samples from x and 
forming the corresponding multiset A. Let also X be the uniform distribution over A. Lemma Q] 
asserts that with probability at least 1 — — the distribution X will satisfy assertion [3] of Lemma [TJ 
However, this does not directly imply a lower bound on the cardinality of A' — it could be that all 
the probability mass is concentrated on a single element of A' . However, the probability that a 
multiset arises by sampling x is at most 

Sn 

since the probability mass that x assigns to every i G [n] is at most Therefore, the total number 
of distinct good multisets in A' is at least 

1-1 



(In) 

Therefore, \A'\ > (1 - ^)(Snf and \A\ > \A'\ > (1 - £)((Jn)*. U 

Proof of Claim [2} From Claim [lj it follows that, if a random multiset A 1 is sampled, the 
probability that it is good is 



n 1 \ nj 

Similarly, if a random multiset B' is sampled, the probability that it is good is 

Pv[B'eB] =fi(«5-n- 161 °g( 1 / 5 )/ e2 ) . 
By independence, it follows that 

Pr [A' e A and B' G B] = Q (d 2 • n -^ g (i/S)/e^\ _ 

But, if A' £ A, B' £ B, then the uniform distribution X' over A' and the uniform distribution y' 
over B' comprise an e-Nash equilibrium (see Proof of Lemma Q] for a justification). Hence, 

Pr [(A^,} 7 ') is an e-Nash equilibrium] 
= 0(<5 2 -^ 321o ^ 1 / 5 )A 2 ). 
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A. 2 The Lower Bound for Bimatrix Games 

In Figure [H we illustrate the game matrix Rs in our construction in the Proof of Theorem [J] 
(Section [3]), for the case n = 6, £ = 4, S = {1,2,3,4}. Each column corresponds to a subset of S 
of size 2. We add then two extra rows to make the matrix square. 

Proof of Lemma [2j The first assertion is easy to justify. Indeed, no matter what y is, the payoff 
Ui of the row player for playing strategy i, i G [n], satisfies: 

• Ui = —1, for all i €" S; 

• Ui > 0, for all i G S; 

Hence, fixing any i! G S, we have, for all i ^ S, that Ui> > Ui + e, which by the definition of an 
e-Nash equilibrium implies that x% = 0. 

Towards justifying the second assertion, let u be the utility of the row player at the e-Nash 
equilibrium (x,y). Since, by the first assertion, Xj = for all i £ S, it follows that the payoff of 
the column player is 1 — u, since the game restricted to the rows of the set S is 1-sum. Since every 
column of Rs restricted to the rows of the set S has exactly half of the entries equal to 1 and the 
other half equal to 0, it follows that 

V ^ ^ t t 

ies j 6 [n] 

It follows that there exists some i* G S such that Uj* > 1/2. By the definition of e-Nash equilibrium, 
it follows then that 

u > ui* - e > 1/2 - e, (8) 

otherwise the row player would be including in his support strategies which are more than e worse 
than i*. 

Let us now consider the payoff of the column player for choosing various strategies j G [n]. 
Without loss of generality let us assume that S = {1, 2, . . . ,£} and that x\ > %2 > ■ ■ ■ > x?. Let j* 
be such that Sj* = {£/2 + 1, 1/2 + 2, . . . ,£}. Then, by the definition of Cs, the payoff of the column 
player for choosing strategy j* is 

1/2 
i=l 

Since (x, y) is an e-Nash equilibrium, it follows that Vj* should be within e from the payoff of the 
column player. Hence, 

Vj* < 1 — u + e. 
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Combining the above with (JSj) , it follows that 

1/2 



< 2e. 



The right hand side of the above, implies £\(x, us) < 8e, by an application of Lemma [3] below, with 
cii = Xi — j, for all i £ [£], k = 2e. 

Lemma 3. Let {ai} e i=l be real numbers satisfying the following properties for some k G R+: 
i. a\ > a2 > . . . > a^; 

5- £•£ ai < 
T/ien 



|ai| < 4k. (9) 



Proof of Lemma [3} We distinguish two cases: (i) > and (ii) < 0- m the first case, we 
have from Conditions Q] and [3] that 

1/2 
i=l 

Using Condition [T] some more we get 

£ ^ 

i>§: a;>0 i>|: a 4 >0 i=1 

Combining the above we get 

N ^ 2A; - ( 10 ) 

i: ai>0 

Now we employ Condition [21 to get 

y~] \(h\ = y (~ a ^ = ai = 1°*' - 2k - ( n ) 

i: a;<0 i: a^<0 i: a;>0 i: a;>0 

We combine (fTUj) . (fTTj) to deduce ([9]). Case (ii) is treated by repeating the above argument with 

ai <- (-a,£-i + i), for all i G [£]. 



Proof of Claims Consider the set V := {u s \S C [n], |5| = £}; note that \V\ = O(rr 81og 2 n ). For 
every us G V consider the set N(us) of all other ^5/ 's that are within t\ distance 17e from it^; it 
is easy to see that \N(us)\ = O(n 34elog 2 n ). Therefore, we can select a subset V C V of at least 
maxs^|jv(ng)| = ^ (n^ 8_34e ) log2n ) elements of V so that every pair of elements is at £\ distance at 
least 17e apart; it follows that for every pair of elements in V' their £\ balls of radius 8e are disjoint. 
The proof is complete. ■ 
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B The Lower Bound for Oblivious PTAS's for Anonymous Games 

B.l Constructing Anonymous Games with Prescribed Equilibria 

Theorem 10. For any collection V : = (pj)«g[fc]; where pi € [3<5fc, 1], for some 5 > and k € N, 
there exists an anonymous game Q-p with k + 2 players, 2 strategies, and 1, payoffs in [—1,1], and 
three player types A,B,C, in which k players, l,...,k, belong to type A, 1 player belongs to type 
B, and 1 player belongs to type C, and such that in every 5' -Nash equilibrium, where 5' < 5, the 
following is satisfied: For every i, player i 's mixed strategy belongs to the set [pi — 7k 2 5,pi + 7k 2 5]; 
moreover, at least one of the players belonging to types B and C play strategy 1 with probability 0. 

Proof. Let us call B the single player of type B and C the single player of type C. Let us also 
use the notation: /i = X)ie[jfc]P»> and A 4 -* = 12je\k]\{i}P^ f° r an Now, let us assign the following 
payoffs to the players B and C: 

• u i = i ' (*A — l 1 ), where tA is the number of players of type A who play strategy 1; 

• u$ = 25; 

• uf = j: ■ (fi — tA), where tA is the number of players of type A who play strategy 1; 

• u% = 25; 

The payoff functions of the players of type A are defined as follows. For all i 6 [k]: 

• u o = ki^-i ' plays o " <^c plays o _ 8k ■ X c plays i), where X B p i ays , X c p i ays and Xq plays i 
are the indicators of the events 'B plays 0', 'C plays 0' and 'C plays 1' respectively. 

• u\ = \{tA-i ■ X B piays o ■ <*C plays q - 5k ■ X B piays 1), where tA-i is the number of players of 
type A who are different than i and play 1, and Xr p i ays o 5 <^c plays o an d X& p i ays i are the 
indicators of the events 'B plays 0', 'C plays 0' and 'B plays 1' respectively. 

Note that the range of all payoff functions of the game thus defined is [—1,1]. We now claim the 
following: 

Claim 4. In every 5' -Nash equilibrium, where 5' < 5, it must be that 

% = £t ± 36k, 

where q\, . . . , q\, are the mixed strategies of the players 1, . . . , k. 

Proof of Claim [4^ Let // = X^e[fc] 1i- Suppose for a contradiction that in a <5'-Nash equilibrium 

fjf > fj, + 35k; then 

-(// - M ) > 35. 

Note however that £[uf ] = — arid £[u^ ] = — -h// — //). Hence, the above implies 

£[u?}>£[u*} + 5, (12) 
£ [«f ] < £ [u$] - 5. (13) 



21 



Since 5' < 5, it must be then that Pr[B plays 1] = 1 and Pr[C plays 1] = 0. It follows then that for 
all i G [k] : 

£[ui\ = 0, 
£[u\] = -5. 

Hence, in a J'-Nash equilibrium with 5' < 5, it must be that Pr[i plays 1] = qi = 0, for all i £ [k]. 
This is a contradiction since we assumed that fjf = J2ie[k] % > ^ + 3<^> an d M * s non-negative. Via 
similar arguments we show that the assumption // < (i — 35k also leads to a contradiction. Hence, 
in every <5'-Nash equilibrium with 5' < 5, it must be that 

fj, = fi± 35k. 



We next show that in every J'-Nash equilibrium with 5' < 5, at least one of the players B and 
C will not include strategy 1 in her support. 

Claim 5. In every 5' -Nash equilibrium with 5' < 5, 

Vt[B plays 1] = or Pr[C plays 1] = 0. 

Proof of Claim [5} Let be the mixed strategies of players 1, ...,k at some <5'-Nash 

equilibrium of the game with 5' < 5. Let us consider the quantity A4 = \{fJ — fj,), where n' = 
X)ie[fc] li- ^ e distinguish the following cases: 

• M<5: In this case, £ [uf] = - < 5 < 25-6 = £ [vfi]-6. Since 5' < 5, Pr[B plays 1] = 
0. 

• M > 5: In this case, £[uf ] = - p) < -6 < 25 - 6 = £[u$] - 5. Since 5' < 5, 
Pr[C plays 1] = 0. 



Finally, we establish the following. 
Claim 6. In every 5' -Nash equilibrium with 5' < 5, it must be that for every player i £ [k]: 

M-i : = ^2 q 'j = ± 4<5/c2 ' 
ie[fc]\{*} 

where qi,---,qk a re the mixed strategies of the players 1,. . . ,k. 

Proof of Claim [§} Let us fix any <5'-Nash equilibrium. From Claim it follows that either 
player B or C plays strategy 1 with probability 0. Without loss of generality, we will assume that 
Pr[C plays 1] = (the argument for the case Pr[B plays 1] = is identical to the one that follows). 

Let us now fix a player i S [k\. We show first that under the assumption Pr[C plays 1] = 0, 
Pr[C plays 0] = 1, it must be that 

fi-i < H-i + $k. (14) 
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Assume for a contradiction that > + 5k. It follows then that 



- Pr[B plays 1]) > - Pr[B plays 1]) 

+ 6k(l -Pr[B plays 1]) 
^> Pr[B plays 0] > Pr[B plays 0] 

+ -Pr[B plays 1]) 
/i-j Pr[B plays 0] Pr[C plays 0] > 

/U_iPr[B plays 0] Pr[C plays 0] 
- 5k Pr[B plays 1] + <5fc 

£ [4] >f[uj] +5. 

But we assumed that we fixed a <5'-Nash equilibrium with 5' < 5; hence the last equation implies 
that qi = 0. But this leads quickly to a contradiction since, if qi = 0, then using Claim [5] we have 

M-i = > H ~ 35k > - pi = 

where we also used that > 35/c. The above inequality contradicts our assumption that /U_j > 
+ Hence, (fTi|) must be satisfied. Using that //<// + 35k, which is implied by Claim HJ) we 

get 

Qi<Pi + 45k. 
From the above discussion it follows that 



Qj < Pj + 4:6k, for all j. (15) 
Now fix i G [k] again. Summing (|15p over all j ^ i, we get that 

fJ-'-i < V~i + 45k 2 . (16) 

Combining and (fT6|) we get 

= fi-i ± 45k 2 . 



To conclude the proof of Theorem 1 10| we combine Claims 0] and [6j as follows. For every player 
i £ [fc], we have from Claims [4] and [6] that in every <5'-Nash equilibrium with 5' < 5, 

= ± 45k 2 and // = /i db 3<5/c. 



By combining these equations we get 

gi = pi ± 7<5/c 2 . 

□ 



B.2 The Lower Bound 

Given Theorem 1101 we can establish our lower bound. 

Proof of Theorem [5} Let us fix any oblivious e-approximation algorithm for anonymous games 
with 2-strategies and 3-player types. The algorithm comes together with a distribution over un- 
ordered sets of mixed strategies — parametrized by the number of players n — which we denote by 
D n . 
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We will consider the performance of the algorithm on the family of games specified in the 
statement of Theorem [10] for the following setting of parameters: 



k= L(l/e) 1/3 J, J=1.01e, V£T e k 
where % := {j • 15e 1/3 | j = 1, . . . , £ e } , t e 



e -l/3 



15 

For technical reasons, let us define the following notion of distance between V, Q £ T^. 



d(V, Q) : = 



V Q 



where v v = {v^ , v^, . . . , vf) is a vector storing the frequencies of various elements of the set T e in 
the collection V, i.e. vj := \{i | i S [k],pi = j ■ 15c 1 / 3 } | . To find the distance between two collections 
P, Q we compute the l\ distance of their frequency vectors. Notice in particular that this distance 
must be an even number. We also need the following definition. 

Definition 2. We say that two anonymous games Q and Q' share an e-Nash equilibrium in un- 
ordered form if there exists an e-Nash equilibrium oq of game Q and an e-Nash equilibrium ogi of 
game Q' such that o~g and o~gi are equal as unordered sets of mixed strategies. 

We show first the following about the shareability of e-Nash equilibria among the games Q-p, 
V G T e k . 

Claim 7. //, forV, Q G T e fc , d(V, Q) > 0, then there is no e-Nash equilibrium that is shared between 
the games Q-p and Qq in unordered form. 

Proof of Claim [3 For all j, let us define the 7.07k 2 e ball around probability j ■ 156 1 / 3 in the 
natural way: 

Bj := [j ■ 15e 1/3 - 7.07k 2 e,j ■ 15e 1/3 + 7.07k 2 e\. 
Observe that for all j > 2: 

(j + 1) • 15e 1/3 - j • 15e 1/3 = 15e 1/3 > 2 • 7.07fc 2 e. 

Hence, for all j,f: Bj n B'j = 0. 

Now, let us consider any pair of e-Nash equilibria og v , ag Q of the games Q-p and Qq and let us 
consider the vectors v ae v = {v l 5v , . . . , v t ^ v ) and v ag Q = (v 1 Gq , . . . , v t ^ Q ) whose j-th components 
are defined as follows: 

(number of players who are 
assigned a mixed strategy from 
the set Bj in ag p 

(number of players who are 
assigned a mixed strategy from 
the set Bj in ag Q 

It is not hard to see that Theorem 1101 and our assumption diV, Q) > imply that ||u <Jg ^ — v as Q ||i > 
0, hence ag v and ag Q cannot be permutations of each other. This concludes the proof. ■ 

Next, we show that there exists a large family of games such that no two members of the family 
share an e-Nash equilibrium. 
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Claim 8. There exists a subset T C such that: 

1. for every V,Q e T: d(T, Q) > 0; 

2. \T\ > 2 f 



,n((i)^; 



Proof of claim [8fc The total number of distinct multi-sets of cardinality k with elements from 71 
is 

te + k-1 
k 

Hence, it is easy to create a subset T C such that: 
• for every V,QeT: d(V, Q) > 0; 

Clearly, the set T satisfies Property [T] in the statement. For the cardinality bound we have: 



Now let us consider the performance of the distribution on the family of anonymous games 
{t/-p}-p g r, where T is the set defined in Claim [HJ By Claims [7] and (HJ no two games in the family 
share an e-Nash equilibrium in unordered form. Hence, no matter what is, there will be some 
game in our family for which the probability that samples an e-Nash equilibrium of that game 
is at most 



1/\T\ < 2 



-Kan 



This concludes the proof of Theorem 



C The Binomial Approximation Theorem 

Proposition 1. Condition (Cd) in the statement of Theorem^is equivalent to the following con- 
dition: 



(V d ): £ 



£ 



\i=l 



, for all £ £ [d]. 



Proof of Proposition [T} 

(Vd) =>■ (Cd)'- It is not hard to see that £ QZ2=i^i) can De written as a weighted sum of the 
elementary symmetric polynomials tp\(V), ^(P)r-A(P) with positive coefficients, where, for all 
£, ipe(V) is defined as 

Mr) ■= Yl 11^ 

5 C [n] ^ s 
\S\=£ 
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(Vd) then implies by induction 

MV) = MQ), for alH = l,...,d. (17) 
Now, for all £, define tt^V) as the power sum symmetric polynomial of degree £ 

n 

Mr) :=X>f- 

i=l 

Now fix any £ < d. Observe that tt^V) is a symmetric polynomial of degree £ on the variables 
pi, . . . ,p n . It follows (see, e.g., [22]) that ir^V) can be expressed as a function of the elementary 
symmetric polynomials ipi(V), . . . ,ipi(V). Since, by (fT7]l . ipj(V) = tpj(Q), for all j < £, we get that 
^i^P) = fte(Q)- Since this holds for any £ < d, (Cd) is satisfied. 

The implication (Cd) =^ (V^) is established in a similar fashion. (Cd) implies 



For any £ < d, £ 



follows (see, e.g., [22]) that £ 



7T<(7>) =vr £ (Q),for all£ = l,...,d. 
is a symmetric polynomial of degree £ on the variables pi, . . . ,p n . It 



(E?=l* 



can be expressed as a function of the power-sum symmet- 



ric polynomials tti(V), . . . , ire(V). And since TTj(V) = TTj(Q), for all j < £, we get £ (X^=i 
(X)"=i ^i) • Since this holds for any £ < d, (Vd) is satisfied. ■ 

Proof of Theorem Let X = X^-^i- The following theorem due to Roos [20], specifies an 
expansion of the distribution function of X as a sum of a finite number of signed measures: the 
binomial distribution B n ^ p (m) (for an arbitrary choice of p) and its first n derivatives with respect 
to the parameter p, at the chosen value of p. More precisely, 

Theorem 11 ([20]). Let V := (pi)'l = \ be an arbitrary set of probability values in [0,1] and X := 
(Xi)f =1 a collection of independent indicators with £\Xj\ = pi, for all i E [n]; also let X := J2i JQ. 
Then, for all m € {0, . . . , n} and any p G (0, 1), 



Pr[X 

where in the above ao(V,p) '■= 1, 
ae(P,p) ■= 

and 



m 



J2az(V,p)-6 l B n>p (m) 



(18) 



£=0 



Yl Y{(Pk(r) ~ P), for all £ G [n], 

Kfc(l)<...<i-(Q<nr=l 



(19) 



??,! 



and /or f/ie purposes of the last definition we interpret 

Bn, P ( m ) := b( m ' n iP) 
as a function of the arguments m,n,p in the natural way: 

b(m, n,p) : = 



™)p m (l - p) n ~ m , for n,me Z + , m < n; 
0, otherwise. 
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Assume now that we are given two collections X, y of indicators as in the statement of Theo- 
rem [71 We claim the following 

Lemma 4. For sets V and Q satisfying property (Cd), and for allp: 

at(V,p) = ai(Q,p), for alii = 0, ... ,d. 

Proof of lemma |4j Clearly, a>o(V,p) = ao(Q,p). Let us fix I € {1, ... , d}. Observe that ae(V,p) 
is a symmetric polynomial of degree t on the variables p±, . . . ,p n . It follows (see, e.g., [22]) that 
a i^P ^p) can be expressed as a function of the power-sum symmetric polynomials iri(V), . . . , ire(V) 
defined as 

n 

*jCP) : =E^' for all je [4 

i=l 

It follows from (Cd) that TTj(V) = TVj(Q), for all j < £; from the previous discussion, this implies 
that ag(V,p) = ag(Q,p). ■ 

For any p £ (0, 1), by combining Lemma |4] and Theorem 1111 we get that 
Pr[X = m] — Pr[Y = m] 

n 

= ^2 ( a e(P'P) ~ &e(Q,p)) ■ S e B n)P (m), for all m. 

l=d+l 

Therefore, for all p: 

1 - 

\\X;Y\\ < - \Pr[X = m] - Pr[Y = m]\ (20) 

m=0 
1 n 

< - £ \Mr,p) - a e (Q,p)\ • H^OHi (21) 

l=d+l 

<\ E (\MV, P )\ + \MQ,p)\) • II^OIIi- (22) 

l=d+l 

From Theorem 2 in [20], it follows that 

n 

- E \a £ (V,p)\-\\S"B n , p (-)\\i 
e=d+i 

y-e(d + i)V* i-^y/eyrfi 

where 

9{Vp) := 2Er = i^-p) 2 +(Er=i(^-p)) 2 

2np(l — p) 

Choosing p = p := ^ ^Pi, we get (see [20]) 
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where p max = maxj {pt} and p m \ n = mirij {pi}. From the above we get 

\ £ mp.johi^wcoiii 



=d+l 



1 



1 d 



- v (v^-l) 2 

< locd + i) 1 /^-^ 1 )/ 2 . 

Since from (C^) we have that p = = Si <7i> we i n a similar fashion 



1 n 

5 E i^(s,P)i-ii^X P -(-)iii<io(d+i) 1/4 2-( d+1 



)/2 



=<f+l 



Plugging these bounds into ([22]) we get 

||x ; y|| < 20(d + l) 1 / 4 2-( d+1 )/ 2 . 



Corollary 1. Lei V '.= (Pi)"=i G [1/2, l) n and Q := (<?j)™ =1 G [1/2, l) n be two collections of proba- 
bility values in [1/2,1). Let also X := (Aj)™ =1 and y := (Yi)f =1 be two collections of independent 
indicators with S[Xi] = pi and £[Yi\ = qi, for all i G [n]. If for some d £ [n] Condition (Cd) is 
satisfied, then 



20(rf+l) 1 / 4 2-( d+1 )/ 2 . 



Proof of Corollary [1} Define X[ = 1 — Xi, and Y- = 1 — Y%, for all i. Apply Theorem [7] to deduce 



E^; E^ 



20((i + l) i/4 2 



l/4 9 -(d+l)/2 



The proof is completed by noting 



E*; E* 



E*i; E^ 



D The non-oblivious PTAS for Anonymous Games 
D.l The Oblivious PTAS of [Daskalakis, 2008] 

In [7J, Theorem [B] was used to design an oblivious PTAS for ra-player 2-strategy anonymous games 
running in time 

poly(n) • (l/e)°^ 2 ) . JJ, 

where U is the number of bits required to represent a payoff value of the game. The algorithm has 
the following structure 
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1. choose k = 0(l/e), according to TheoremEl 

2. guess the number t of players who randomize, the number to of players who 
play 0, and the number t± = n — t — to of players who play 1; 

3. depending on the number t of players who mix try one of the following: 

(a) if t < A; 3 , guess the number of players playing each of the integer 
multiples i/k 2 of p-, and, solving a max- flow instance (see details in [7]), 
check if there is a e-Nash equilibrium in which ipi players play i/k 2 , for 
all i, to players play 0, and t\ players play 1; 

(b) if t > A; 3 , guess an integer multiple i/kn of 1/kn and, solving a max- flow 
instance, check if there is an e-Nash equilibrium in which t players play 
i/kn, to players play 0, and t\ players play 1. 

Figure 2: The oblivious PTAS of [Daskalakis, 2008] 

Clearly, there are 0(n 2 ) possible choices for Step [2] of the algorithm. Moreover, the search of 
Step [3b] can be completed in time (see [7J ) 

*7-pdy(n)-(l/e)log 2 (l/e), 

which is polynomial in 1/e. On the other hand, Step I3al involves searching over all partitions of t 
balls into k 2 — 2 bins. The resulting running time for this step (see details in [7J) is 

l7-poly(n) • (l/e) ^ 2 ), 

which is exponential in 1/e. 

D.2 Moment Search : Missing Details 

We describe in detail the third step of Moment Search. 
3. For each player i = 1, . . . , n, find a subset 

„ f 1 k 2 -l ) 

of permitted mixed strategies for that player in an e-Nash equilibrium, "conditioning" on 
the total number of players playing being to, the total number of players playing 1 being 
t\, and the probabilities of the players who mix resulting in the power-sums fj,±, . . . , and 
u[, . . . , u' d . The way we compute the set Si is as follows: 

(a) To determine whether G Si'. 

i. Find any set of mixed strategies q\, . . . , qt s Q {vs, T7, ■ ■ ■ such that Yll=i 1i = 
for all £ = 1, . . . , d. Find any set of mixed strategies r±, . . . ,r tb C { | + -k , | + 
p-, . . . , 1 — p-} such that Y^i=i r l = /4> f° r all £ = 1, . . . ,d. If such values do not 
exist Fail. 

Remark: An efficient algorithm to solve this optimization problem is described in 
the proof of Claim [TT1 
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ii. Define the random variable 

Y = (t - 1) • + J2 Si + B i + *i • X > 

i=l i=l 

where the variables Si, . . . , St s , B\, . . . , Bt b are mutually independent with expecta- 
tions £ [Si] = qi, for all i = 1, . . . , t s , and £\Lj\ = rj, for all i = 1, . . . , tb- 

iii. Compute the expected payoff Uq = £ [u^iy)] and U\ = f [it^(y)] of player i for play- 
ing and 1 respectively, if the number of the other players playing 1 is distributed 
identically to Y. 

iv. if ZYq > IA\ — 3e/4, then include to the set Si, otherwise do not. 

(b) To determine whether 1 £ Si, follow the same strategy except now Y is defined as follows 

Y=t -o+Y,Si+j2 Bi+ ( ti ~ i y i > 

i=l i=l 

to account for the fact that we are testing for the candidate strategy 1 for player i. Also, 
the test that determines whether 1 G Si is now U\ >Uq — 3e/4. 

(c) For all j £ {1, . . . , k 2 /2}, to determine whether j/k 2 G Si do the following slightly 
updated test: 

i. Find any set of mixed strategies q\, . . . , qt a -i Q {pr, Sz, ■ ■ ■ , 1/2} such that Yll'^i 1 1i = 
fj,£ — (j/k 2 y, for all £ = 1, . . . , d. Find any set of mixed strategies 

1112 1 

ri, ■ ■ ■ ,n b - L2^£?'2^/?''' _ fc2 

such that Y^i=i r i = rfii f° r all £ = 1, . . . , d. If such values do not exist Fail. 

ii. Define the random variable 

t s -l t b 

Y = t -o+j2 s i+J2 Bi+t ^ 1 ' 

i=l i=l 

where the variables Si, . . . , St s -i, B\, . . . , B tb are mutually independent with £ [Si] = 
qi, for all i = 1, . . . , t s — 1, and £[Li] = ri, for all i = 1, . . . , tb- 

iii. Compute the expected payoff Uq = <S[uo(^)] and U\ = of player i for play- 
ing and 1 respectively, if the number of the other players playing 1 is distributed 
identically to Y . 

iv. if ZYq G [U{ — 3e/4,W] + 3e/4], then include j/k 2 to the set Si, otherwise do not. 

(d) For all j G {(k 2 + 2)/2, . . . , k 2 — 1}, to determine whether j/k 2 G Si do the appropriate 
modifications to the method described in Step l3cl 

D.3 The Analysis of Moment Search 

Correctness The correctness of Moment Search follows from the following two claims. 

Claim 9. If there exists an e/2-Nash equilibrium in which t < fc 3 players mix, and their mixed 
strategies are integer multiples of 1/k 2 , then Moment Search will not fail, i.e. it will output a 
set of mixed strategies (v\, . . . , v n ). 
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Claim 10. //Moment Search outputs a set of mixed strategies (v\, . . . ,v n ), then these strategies 
constitute an e-Nash equilibrium. 

Proof of Claim [9fc Let (p\, . . . ,p n ) be an e/2-Nash equilibrium in which to players play 0, ti 
players play 1, and t < k s players mix, and their mixed strategies are integer multiples of 1/k 2 . It 
suffices to show that there exist guesses for i 0) t s , fi\, . . . , fid, fJ-'i, ■ ■ ■ 5 ^ sucn that p\ G Si, 
p 2 G S 2 ,- ■ ., p n G S n . Indeed, let 

Z := {i\ Pi = 0}, l s := {i\ Pi G (0, 1/2]}, 

X fe := {i\ Pi G (1/2, 1)}, X! := {i\ Pi = 1}, 
and let us choose the following values for our guesses 

*o := |2<)|)*s = \Zs\, h = '■= l^i I 

and, for all I G [d], 



fit 



53 Pi. ^ = 53^- 



We will show that for the guesses that we defined above pi G Si, for all i. We distinguish the 
following cases: i G 2o, % G X s , i G i G Xi. The proof for all the cases proceeds in the same 
fashion. We will only argue about the case i G I s ; in particular, we will show that in Step [3cl of 
Moment Search the test succeeds for j/k 2 = pi. 

At the equilibrium point (pi, . . . ,p n ), the number of the other players who choose strategy 1, 
from the perspective of player i, is distributed identically to the random variable: 

where £[Xj] = pj for all j. Since (pi,... ,p n ) is an e/2-Nash equilibrium it must be the case that 

\£[u (Z)]-£[u\(Z)}\<e/2. (23) 

We will argue that, if in the above equation, we replace Z by Y, where Y is the random variable 
defined in Step 3(c)ii of Moment Search, the inequality still holds with slightly updated upper 
bound: 



\£[u Q (Y)]-£[u\(Y)]\<3e/4. 



(24) 



If (|24p is established, the proof is completed since Step 3(c)iv will include j/k into the set Si. 

Let Si, . . . , St a -i, Bi, . . . , B tb be the random variables with expectations qi, . . . ,qt a -i,ri, . . . ,r tb 
defined in Step 3(c)ii of Moment Search. Observe that, for all £ = 1, . . . , d, 

t e -l 

^2qj = fie-U/k 2 ) 1 - ^ n , 



53 p ^ 

iei.\{i} 



since pi = j/k 2 . Hence, by Theorem [7J 



t.-\ 



E^»- E 



< 20(d + l) 1 / 4 2-( d+1 )/ 2 < e /16. 



(25) 
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Via similar arguments and Corollary Q3 we get 



£*;-£*, 

3=1 j&b 



< e/16. 



(26) 



and 



imply via the coupling lemma 



\Y:Z\\ < 



(27) 



It is not hard to see that 



\S[vh(X)]-S[^(Z)]\<\\Y;Z\\<-, 

where we used (|27p . Similarly, 

\£[u\(Y)]-£[u\(Z)]\<\\Y;Z\\< e -. 

Combining the above with (I23D we get (I24p . This concludes the proof. ■ 
Proof of Claim [10} Let 

X := OK = 0}, l s := {i\vi € (0, 1/2]}, 
X fe := S (1/2, 1)}, X x := {i\ Vi = 1}, 

Observe that the moment values that were guessed in Step [2] of Moment Search satisfy 

H = £ vf, n' t = ^2 v t for all € = 1, . . . , d. 



We will argue that (yi, ... , v n ) is an e-Nash equilibrium. To do this we need to argue that, 
for each player i, vi is an e-well supported strategy against the strategies of her opponents. We 
distinguish the following cases: i E Iq, i £ T s , i S 2j,, i S X\. The proof for all the cases proceeds 
in a similar fashion. We will only present the argument for the case i G I s . 

Let Vi = j/k 2 for some j E {1, . . . , ^-}. From the perspective of player i, the number of other 
players who play 1 in the mixed strategy profile (v±, . . . ,v n ) is distributed identically to the random 
variable 

je[n]\{i} 

where £ [Xj] = Vj for all j. To argue that Vi is an e-well supported strategy against the strategies 
of i's opponents, we need to show that 

\£[ui(Z)]-£[ U \(Z)}\<e. (28) 

Let us now go back to the iteration of Step [3c] in which the probability value j/k 2 was inserted 
into the set Si. Let q±, ... , qt a -i, r±, . . . , r tb be the values that were selected at Step 3(c)i of that 
iteration, and let 

t a — l tb 

3=1 3=1 
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be the random variable denned in Step 3(c)ii where the variables Si, . . . , St 3 -i, B±, . . . , B tb are 



mutually independent with expectations £[Si] = q%, for all i = 1, . . . ,t s — 1, and £[Bj\ = ri, for all 
i = 1, ... ,£;,. Observe that the gj's and r^-'s where chosen by Step 3(c)i so that the following are 
satisfied 



t 3 -i 

E i = w - U/k 2 Y = nz-vl= v h for a11 1 G 

and ^ r j = fjf e = V] uj, for all £ = 1, . . . , d. 

i=i jex 6 



Equation (j29|) implies via Theorem [7] that 



t s -l 



E s i- E ^ 



Equation (j30|) and Corollary Q] imply 

t6 



< 20(d+ l)V4 2 -(d+l)/2 < £ / 16 



i=i jex 6 



< e/16. 



(|3ip and (I32p imply via the coupling lemma 

||y;Z|| < -. 

II , II - g 

It is not hard to see that 

\£[v^{Y)\-£[4(Z)\\<\\Y-Z\\< e -, 

where we used (|3"3"j) . Similarly 

\£[u\(Y)]-£[ U [(Z)]\<\\Y;Z\\< € -. 

Moreover, notice that the random variable Y satisfies the following condition 

\£[ui(Y)]-£[u\(Y)}\<3e/4, 



(29) 
(30) 



(31) 



(32) 



(33) 



(34) 



(35) 



(36) 



since, in order for V{ to be included into Si, the test in Step 3(c)iv of Moment Search must have 
succeeded. Combining (|34"]). (j35|) and ([36]) we get (j28|) . This concludes the proof. ■ 

Computational Complexity We will argue that there exists an implementation of Moment 
Search which on input k = 0(1/ e) runs in time 

[/•poly(n) • (l/e) ^ 1 / 6 )), 

where U is the number of bits required to represent a payoff value of the game. 

Observe first that the number of possible guesses for Step Q] of Moment Search is at most 
n 2 0((l/e) 6 ). Observe further that the number of possible guesses for fig in Step [2] is at most 
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t \j2~) (where t < k 3 is the number of players who mix), so jointly the number of possible guesses 
for fjbi, . . . is at most 

The same asymptotic upper bound applies to the total number of guesses for fjf 1} . . . , fi' d . Given the 
above the total number of guesses that Moment Search has to do is 

We next argue that the running time required to complete Steps El [U and [5] is at most 

/n O(log 2 (l/ £ )) 
0( n 3) -U-l-J 

For this we establish the following; we give the proof in the end of this section. 
Claim 11. Given a set of values fj,i, . . . , fid, fJ>i, ■ ■ ■ , A 4 ^' w here, for all I = 1, . . . , d, 

«,^0,(£)',2(£)',...,b}, 

/or some B £ N, discrete sets T\, ■ ■ ■ ,T m Q {0, -rj, . . . , l} ; and four integers mo, mi < m, 
m s ,m(, < 7?, if is possible to solve the system of equations: 





= A 4 ^ 


/or all 1= 1, . . 


. , o! 


Pi 6 (0,1/2] 








E ^ 


= a4 


/or all £ = 1, . . 


.,d 


Pi£(l/2,1) 








|{*lft = 0}| 


= m 






= 1}I 


= mi 






|{i|piG(0,l/2]}| 


= m s 






|{i|we(i/2,i)}| 


= m fe 







i/rai/i respect to the variables p\ £ 71, . . . ,p m 6 7^, or to determine that no solution exists, in time 

Applying Claim [TT] with m < t, B < t (where t < A; 3 is the number of players who mix), mo = 0, 
mi = 0, shows that Steps 3(a)i 3(c)i can be completed in time 

\ 0(log 2 (l/e)) 



/ 1 \ 1 

0{t 3 )t o( d ) k o( d *) = m 
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Another application of Claim [TT] with m = n, B < t, mo < n, mi < n shows that Step H] of 
Moment Search can be completed in time 

/1N 0(log 2 (l/e)) 



Finally, we argue that the computation of the expected utilities Uq and U\ required in Steps 3(a)iii 
3(c)iii of Moment Search can be done efficiently using dynamic programming with 0{n 2 ) opera- 



tions on numbers with at most b(n, k) := [1 + nlog 2 (A; 2 ) + U)~\ bits, where U is the number of bits 
required to specify a payoff value of the gamell 

Therefore, the overall time required for the execution of Moment Search is 

m 0(log 2 (l/e)) 

cV) • u ■ \-j 

Proof of Claim lilt We use dynamic programming. Let us consider the following tensor of 
dimension 2d + 5: 

A(i, z ,Z!,z s , z b ; v u . . . , u d ; u[, . . . , u' d ), 
where i S [m], zq, z± G {0, . . . , m}, z s ,Zb € {0, ... , B} and 



u£,u' f e < o, 



A' 2 



k 2 



,...,B}, 



for I = 1, . . . , d. The total number of cells in A is 



m 



(m + l) 2 • (B + l) 2 • (jh Bk2i + !) j 

<0{m i )B°^k 2d ^ d+l \ 



Every cell of A is assigned value or 1, as follows: 



A(i,z ,z 1 ,z s ,z b ;u 1 , . . . , v d , u[ , . . . , u' d ) = 1 

I There exist p± G 7i , . . . , Pi G % such ^ 
that \{j < i\pj = 0}| = zq, 

\{j < i\Pj = 1}| = zi, 
\{j<i\Pj € (0,1/2]}| =z s , 
\{j<i\Pj G (1/2, 1)}] =z b , 

^j<i: P Mom pe i = vt > for a11 
1> • • • , d, Z)j<i:p 3 e (1/2,1) Pj = v 'b for 
all£ = l,...,d. 
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5 To compute a bound on the number of bits required for the expected utility computations, note that every non- 
zero probability value that is computed along the execution of the algorithm must be an integer multiple of (-rz) n ~ , 
since the mixed strategies of all players are from the set {0, 1/fc 2 , 2/k 2 , . . . , 1}. Further note that the expected utility 
is a weighted sum of (n — 1) payoff values, with U bits required to represent each value, and all weights being 
probabilities. 
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It is easy to complete A working in layers of increasing i. We initialize all entries to value 0. Then, 
the first layer A(l, •, • ; •,...,•) can be completed easily as follows: 

A(l, 1, 0, 0, 0; 0, 0, . . . , 0; 0, 0, . . . , 0) = 1 & £ Ti 
,4(1, 0, 1, 0, 0; 0, 0, . . . , 0; 0, . . . , 0) = 1 ^ 1 E 71 
A(l,0,0,l,0;p,p 2 ,...,/;0,...,0) = 1 p € Ti D (0, 1/2] 
A(l,0,0,0,l;0,...,0;p,p 2 ,...,p < ') = 1 ^p e Ti D (1/2, 1) 

Inductively, to complete layer i + 1, we consider all the non-zero entries of layer i and for every such 
non-zero entry and for every t>j + i 6 77+i , we find which entry of layer i + 1 we would transition to 
if we chose Pi+i = Ui+i- We set that entry equal to 1 and we also save a pointer to this entry from 
the corresponding entry of layer i, labeling that pointer with the value Vi+\. The time we need to 
complete layer i + 1 is bounded by 

\T l+1 \.{m+l?B 0{ ~ d h 2d ^ < 0(m 2 )B°^k°^\ 

Therefore, the overall time needed to complete A is 

0(m 3 )B°^k°^. 

After completing tensor A, it is easy to check if there exists a solution to (£). A solution exists 
if and only if 

A(m,m ,mi,m s ,m b ; fii, . . . ,Hd\^i, ■■■ = 1, 

and can be found by tracing back the pointers from this cell of A. The overall running time is 
dominated by the time needed to fill in A. ■ 
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